Online optimization algorithms

نویسنده

  • David Andrzejewski
چکیده

This project surveys some recent algorithms and results in the field of online learning theory [5][6][7]. The problem context is that of an online decision problem, where one must choose a point xt from a fixed set K for each round t. After a choice has been made, a cost function ft(x) for that round is revealed and used to compute the cost of that decision. On the next round t + 1, a new point xt+1 must be chosen, a new cost function ft+1(x) will be revealed, and so on. The goal then is to minimize the regret R, the difference between the cumulative cost of the single best point chosen in hindsight x and the cumulative cost of the sequence of points chosen by the online procedure x1...T .

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

STRUCTURAL OPTIMIZATION PROBLEMS OF THE ISCSO 2011-2015: A TEST SET

Beginning  in  2011  an  international  academic  contest  named  as  International  Student Competition  in  Structural  Optimization  (ISCSO)  has  been  organized  by  the  authors  to encourage undergraduate and graduate students to solve structural engineering optimization&nbs...

متن کامل

Efficient algorithms for online convex optimization and their applications

In this thesis we study algorithms for online convex optimization and their relation to approximate optimization. In the first part, we propose a new algorithm for a general online optimization framework called online convex optimization. Whereas previous efficient algorithms are mostly gradient-descent based, the new algorithm is inspired by the Newton-Raphson method for convex optimization, a...

متن کامل

Meta Online Learning: Experiments on a Unit Commitment Problem

Online learning is machine learning, in real time from successive data samples. Meta online learning consists in combining several online learning algorithms from a given set (termed portfolio) of algorithms. The goal can be (i) mitigating the effect of a bad choice of online learning algorithms (ii) parallelization (iii) combining the strengths of different algorithms. Basically, meta online l...

متن کامل

A Unified Approach to Adaptive Regularization in Online and Stochastic Optimization

We describe a framework for deriving and analyzing online optimization algorithms that incorporate adaptive, data-dependent regularization, also termed preconditioning. Such algorithms have been proven useful in stochastic optimization by reshaping the gradients according to the geometry of the data. Our framework captures and unifies much of the existing literature on adaptive online methods, ...

متن کامل

Online Scheduling of Jobs for D-benevolent instances On Identical Machines

We consider online scheduling of jobs with specic release time on m identical machines. Each job has a weight and a size; the goal is maximizing total weight of completed jobs. At release time of a job it must immediately be scheduled on a machine or it will be rejected. It is also allowed during execution of a job to preempt it; however, it will be lost and only weight of completed jobs contri...

متن کامل

Black-Box Reductions for Parameter-free Online Learning in Banach Spaces

We introduce several new black-box reductions that significantly improve the design of adaptive and parameterfree online learning algorithms by simplifying analysis, improving regret guarantees, and sometimes even improving runtime. We reduce parameter-free online learning to online exp-concave optimization, we reduce optimization in a Banach space to one-dimensional optimization, and we reduce...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2007